Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix versions in requirements.txt for python 3.5 and 3.9 #20507

Merged
merged 5 commits into from
Aug 10, 2020

Conversation

jsoriano
Copy link
Member

@jsoriano jsoriano commented Aug 10, 2020

What does this PR do?

Fix versions of packages in requirements.txt file so they can be installed in all python versions from 3.5 to 3.9.

Added a cleaned-up version of a one-liner I was using to check the requirements.txt file with different versions.

Why is it important?

Packages listed in current requirements.txt file cannot be installed in python 3.5 and 3.9:

We still need to support python 3.5 because it is used in some CI workers.

@jsoriano jsoriano added bug review :Testing Team:Integrations Label for the Integrations team labels Aug 10, 2020
@jsoriano jsoriano self-assigned this Aug 10, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/integrations (Team:Integrations)

@botelastic botelastic bot added needs_team Indicates that the issue/PR needs a Team:* label and removed needs_team Indicates that the issue/PR needs a Team:* label labels Aug 10, 2020
@elasticmachine
Copy link
Collaborator

elasticmachine commented Aug 10, 2020

❕ Build Aborted

Either there was a build timeout or someone aborted the build.'}

Pipeline View Test View Changes Artifacts

Expand to view the summary

Build stats

  • Build Cause: [Pull request #20507 updated]

  • Start Time: 2020-08-10T12:16:50.306+0000

  • Duration: 122 min 23 sec

Test stats 🧪

Test Results
Failed 0
Passed 17679
Skipped 1929
Total 19608

Log output

Expand to view the last 100 lines of log output

[2020-08-10T14:18:42.160Z] + python .ci/scripts/search_system_tests.py
[2020-08-10T14:18:42.214Z] [INFO] system-tests=''. If no empty then let's create a tarball
[2020-08-10T14:18:43.737Z] Failed in branch Libbeat x-pack
[2020-08-10T14:18:43.865Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats
[2020-08-10T14:18:44.176Z] + find . -type f -name TEST*.xml -path */build/* -delete
[2020-08-10T14:18:44.189Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Lint
[2020-08-10T14:18:44.275Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Elastic-Agent-Mac-OS-X
[2020-08-10T14:18:44.356Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Elastic-Agent-x-pack
[2020-08-10T14:18:44.435Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Auditbeat-oss-Mac-OS-X
[2020-08-10T14:18:44.515Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Auditbeat-x-pack-Mac-OS-X
[2020-08-10T14:18:44.594Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Winlogbeat-oss
[2020-08-10T14:18:44.671Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Dockerlogbeat
[2020-08-10T14:18:44.759Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Auditbeat-crosscompile
[2020-08-10T14:18:44.836Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Journalbeat-oss
[2020-08-10T14:18:44.915Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Filebeat-x-pack-Mac-OS-X
[2020-08-10T14:18:44.994Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Functionbeat-x-pack
[2020-08-10T14:18:45.071Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Generators-Metricbeat-Linux
[2020-08-10T14:18:45.149Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Filebeat-Mac-OS-X
[2020-08-10T14:18:45.226Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Elastic-Agent-x-pack-Windows
[2020-08-10T14:18:45.307Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-Mac-OS-X
[2020-08-10T14:18:45.384Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Packetbeat-Linux
[2020-08-10T14:18:45.460Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-x-pack-Mac-OS-X
[2020-08-10T14:18:45.539Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-OSS-Unit-tests
[2020-08-10T14:18:45.617Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Heartbeat-oss
[2020-08-10T14:18:45.694Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Auditbeat-oss-Windows
[2020-08-10T14:18:45.773Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Auditbeat-x-pack
[2020-08-10T14:18:45.851Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Auditbeat-x-pack-Windows
[2020-08-10T14:18:45.929Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Winlogbeat-Windows-x-pack
[2020-08-10T14:18:46.007Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Functionbeat-Mac-OS-X-x-pack
[2020-08-10T14:18:46.086Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Auditbeat-oss-Linux
[2020-08-10T14:18:46.164Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-crosscompile
[2020-08-10T14:18:46.241Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Filebeat-x-pack-Windows
[2020-08-10T14:18:46.321Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Heartbeat-Mac-OS-X
[2020-08-10T14:18:46.397Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Packetbeat-Mac-OS-X
[2020-08-10T14:18:46.476Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Filebeat-Windows
[2020-08-10T14:18:46.555Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-Windows
[2020-08-10T14:18:46.635Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Winlogbeat-Windows
[2020-08-10T14:18:46.719Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-x-pack-Windows
[2020-08-10T14:18:46.795Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Heartbeat-Windows
[2020-08-10T14:18:46.871Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Generators-Beat-Linux
[2020-08-10T14:18:46.948Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Functionbeat-Windows
[2020-08-10T14:18:47.025Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Filebeat-oss
[2020-08-10T14:18:47.101Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Filebeat-x-pack
[2020-08-10T14:18:47.179Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Libbeat-oss
[2020-08-10T14:18:47.263Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Packetbeat-Windows
[2020-08-10T14:18:47.340Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Libbeat-crosscompile
[2020-08-10T14:18:47.421Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Libbeat-stress-tests
[2020-08-10T14:18:47.499Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-OSS-Go-Integration-tests
[2020-08-10T14:18:47.580Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Generators-Metricbeat-Mac-OS-X
[2020-08-10T14:18:47.657Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-OSS-Python-Integration-tests
[2020-08-10T14:18:47.734Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-x-pack
[2020-08-10T14:18:47.818Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Generators-Beat-Mac-OS-X
[2020-08-10T14:18:47.897Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Libbeat-x-pack
[2020-08-10T14:18:48.261Z] + cat
[2020-08-10T14:18:48.261Z] + /usr/local/bin/runbld ./runbld-script
[2020-08-10T14:18:48.261Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-08-10T14:18:56.409Z] runbld>>> runbld started
[2020-08-10T14:18:56.409Z] runbld>>> 1.6.12/f45d832f2ba0aa2722ab4ec1fda8ad140f027f8b
[2020-08-10T14:18:57.792Z] runbld>>> The following profiles matched the job 'Beats/beats/PR-20507' in order of occurrence in the config (last value wins).
[2020-08-10T14:18:59.173Z] runbld>>> Debug logging enabled.
[2020-08-10T14:18:59.173Z] runbld>>> Storing result
[2020-08-10T14:18:59.434Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-08-10T14:18:59.434Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200810141859-80D9F51E
[2020-08-10T14:18:59.434Z] runbld>>> Adding system facts.
[2020-08-10T14:19:00.833Z] runbld>>> Adding vcs info for the latest commit:  f59c0f9085458f481e2abb5cf29817f366b4a8dc
[2020-08-10T14:19:00.833Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-08-10T14:19:00.833Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-08-10T14:19:00.833Z] Processing JUnit reports with runbld...
[2020-08-10T14:19:00.833Z] + echo 'Processing JUnit reports with runbld...'
[2020-08-10T14:19:01.100Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-08-10T14:19:01.100Z] runbld>>> DURATION: 30ms
[2020-08-10T14:19:01.100Z] runbld>>> STDOUT: 40 bytes
[2020-08-10T14:19:01.100Z] runbld>>> STDERR: 49 bytes
[2020-08-10T14:19:01.100Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-08-10T14:19:01.100Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats
[2020-08-10T14:19:02.043Z] runbld>>> Storing build metadata: 
[2020-08-10T14:19:02.043Z] runbld>>> Adding test report.
[2020-08-10T14:19:02.043Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats
[2020-08-10T14:19:02.986Z] runbld>>> Found 135 test output files
[2020-08-10T14:19:04.370Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-openmetrics.xml
[2020-08-10T14:19:04.370Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-iis.xml
[2020-08-10T14:19:04.370Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-istio.xml
[2020-08-10T14:19:04.370Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-tomcat.xml
[2020-08-10T14:19:04.370Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-activemq.xml
[2020-08-10T14:19:04.370Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-OSS-Go-Integration-tests/metricbeat/build/TEST-go-integration-graphite.xml
[2020-08-10T14:19:04.370Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20507/src/github.com/elastic/beats/Metricbeat-OSS-Go-Integration-tests/metricbeat/build/TEST-go-integration-windows.xml
[2020-08-10T14:19:06.282Z] runbld>>> Test output logs contained: Errors: 0 Failures: 0 Tests: 19458 Skipped: 1658
[2020-08-10T14:19:06.543Z] runbld>>> Storing result
[2020-08-10T14:19:06.543Z] runbld>>> FAILURES: 0
[2020-08-10T14:19:06.543Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-08-10T14:19:06.543Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200810141859-80D9F51E
[2020-08-10T14:19:06.804Z] runbld>>> Email notification disabled by environment variable.
[2020-08-10T14:19:06.804Z] runbld>>> Slack notification disabled by environment variable.
[2020-08-10T14:19:12.317Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats_PR-20507
[2020-08-10T14:19:12.421Z] [INFO] getVaultSecret: Getting secrets
[2020-08-10T14:19:12.506Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-08-10T14:19:13.283Z] + chmod 755 generate-build-data.sh
[2020-08-10T14:19:13.283Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20507/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20507/runs/5 ABORTED 7342716
[2020-08-10T14:19:13.283Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20507/runs/5/steps/?limit=10000 -o steps-info.json
[2020-08-10T14:19:15.766Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20507/runs/5/tests/?status=FAILED -o tests-errors.json

@jsoriano jsoriano added the needs_backport PR is waiting to be backported to other branches. label Aug 10, 2020
@jsoriano
Copy link
Member Author

Failing test is fixed in master, merging.

@jsoriano jsoriano merged commit 8593c85 into elastic:master Aug 10, 2020
@jsoriano jsoriano deleted the fix-versions-requirements-3-9 branch August 10, 2020 15:29
@jsoriano
Copy link
Member Author

Will apply the changes in 7.x branch on the backport PR for pytest #20478

@jsoriano jsoriano removed the needs_backport PR is waiting to be backported to other branches. label Aug 10, 2020
melchiormoulin pushed a commit to melchiormoulin/beats that referenced this pull request Oct 14, 2020
Packages listed in current requirements.txt file cannot be installed in
python 3.5 and 3.9:
* Pillow doesn't have a candidate for 3.9, it was already removed
  in elastic#20407, but added again by mistake in elastic#16883.
* zipp package needed by pytest works with different versions depending
  on the version of python, version that works with python 3.5 doesn't work
  with other versions.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug review Team:Integrations Label for the Integrations team :Testing
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants